An Affect-Sensitive Social Interaction Paradigm Utilizing Virtual Reality Environments for Autism Intervention

This paper describes the design and development of both software to create social interaction modules on a virtual reality (VR) platform and individualized affective models for affect recognition of children with autism spectrum disorders (ASD), which includes developing tasks for affect elicitation and using machine-learning mathematical tools for reliable affect recognition. A VR system will be formulated that can present realistic social communication tasks to the children with ASD and can monitor their affective response using physiological signals, such as cardiovascular activities including electrocardiogram, impedance cardiogram, photoplethysmogram, and phonocardiogram; electrodermal activities including tonic and phasic responses from galvanic skin response; electromyogram activities from corrugator supercilii, zygomaticus major, and upper trapezius muscles; and peripheral temperature. This affect-sensitive system will be capable of systematically manipulating aspects of social communication to more fully understand its salient components for children with ASD.